Point Cloud Semantic Scene Completion from RGB-D Images

نویسندگان

چکیده

In this paper, we devise a novel semantic completion network, called point cloud scene network (PCSSC-Net), for indoor scenes solely based on clouds. Existing networks still suffer from their inability of fully recovering complex structures and contents global geometric descriptions neglecting hints. To extract infer comprehensive information partial input, design patch-based contextual encoder to hierarchically learn point-level, patch-level, scene-level with divide-and-conquer strategy. Consider that the semantics afford high-level clue constituting geometry an environment, articulate semantics-guided decoder where could help cluster isolated points in latent space complicated geometry. Given fact real-world scans tend be incomplete as ground truth, choose synthesize dataset RGB-D images annotate complete clouds truth supervised training purpose. Extensive experiments validate our new method achieves state-of-the-art performance, contrast current methods applied dataset.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning 3D Scene Synthesis from Annotated RGB-D Images

We present a data-driven method for synthesizing 3D indoor scenes by inserting objects progressively into an initial, possibly, empty scene. Instead of relying on few hundreds of hand-crafted 3D scenes, we take advantage of existing large-scale annotated RGB-D datasets, in particular, the SUN RGB-D database consisting of 10,000+ depth images of real scenes, to form the prior knowledge for our s...

متن کامل

Indoor Scene Point Cloud Registration Algorithm Based on RGB-D Camera Calibration

With the increasing popularity of RGB-depth (RGB-D) sensor, research on the use of RGB-D sensors to reconstruct three-dimensional (3D) indoor scenes has gained more and more attention. In this paper, an automatic point cloud registration algorithm is proposed to efficiently handle the task of 3D indoor scene reconstruction using pan-tilt platforms on a fixed position. The proposed algorithm aim...

متن کامل

21/2 D Scene Reconstruction of Indoor Scenes from Single RGB-D Images

Using the Manhattan world assumption we propose a new method for global 21/2D geometry estimation of indoor environments from single low quality RGB-D images. This method exploits both color and depth information at the same time and allows to obtain a full representation of an indoor scene from only a single shot of the Kinect sensor. The main novelty of our proposal is that it allows estimati...

متن کامل

Combining Models from Multiple Sources for RGB-D Scene Recognition

Depth can complement RGB with useful cues about object volumes and scene layout. However, RGB-D image datasets are still too small for directly training deep convolutional neural networks (CNNs), in contrast to the massive monomodal RGB datasets. Previous works in RGB-D recognition typically combine two separate networks for RGB and depth data, pretrained with a large RGB dataset and then fine ...

متن کامل

Depth CNNs for RGB-D scene recognition: learning from scratch better than transferring from RGB-CNNs

Scene recognition with RGB images has been extensively studied and has reached very remarkable recognition levels, thanks to convolutional neural networks (CNN) and large scene datasets. In contrast, current RGB-D scene data is much more limited, so often leverages RGB large datasets, by transferring pretrained RGB CNN models and fine-tuning with the target RGB-D dataset. However, we show that ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2021

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v35i4.16451